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This project identified the specific goals sought by 
a group of off-campus study program directors having much experience 
who developed an appropriate instrument to assess whether or not the 
student participants perceived these goals as having been actualized 
within themselves. The research, instrument developed for the 
assessment was the Individual Opinion Inventory (101) . Results 
emerging from this phase of the project indicated: (1) that students 
o^d-if feirent academic majors responded differently to the instrument, 
with students in the humanities scoring category items significantly 
more favorably than students in the sciences; (2) associations of 
statistical significance were found between the ^3 experimental 
categories of the instrument and (a) the student's present interest 
in the are?, of off-campus study, (b) the student's present amount of 
reading about that area, and (c) the student's present amount of 
correspondence with individuals living in the off-campus study 
location . (M JM) 
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THE INDIVIDUAL OPINION INVENTORY: 
A PROGRESS REPORT ON THE 
ASSESSMENT OF OFF-CAMPUS AND 
OVERSEAS STUDY PROGRAMS 

Walter H. Lemke, Jr/' 

I. The Need 

From classical Greece to modem America, a 
stt'dy sejour away from one's home area has been 
considered a component not only of an ideal, for- 
ma! education but also of a complete, personal de- 
velopment. Through a ^'natural" process of accul- 
turation, the student living and studying outside 
of his home location theoretically supplements his 
intellect, expands his cultural awareness, and com- 
plements his emotional maturation. Such an ex- 
perience is deemed to ofTer intellectual and social 
rewards ani to precipitate positive changes both 
cognitive and affective. 

Until 1919, when the Institute of International 
Ediication was founded, study abroad was deter- 
mined by individual initiative and supportive 
funds, available from family or patron. After 
World War I, however, junior year abroad pro- 
grams were institutionalized by the University of 
Delaware and Sweet Briar College, organizing for 
the first time an activity generally believed educa- 
tionally and personally beneficial. Since the Twen- 
ties, an indiscriminate proliferation of olT-campus 
study programs, both in (his country and abroad — 
ranging in quality from the sublime to the abomi- 
nable—has occurred. Unfortunately, while the ex- 
perience itself is preconceived as valuable, no com- 
pletely adequate method of assessment exists. To 
create or endorse educational policy on the basis 
of oral tradition on hearsay history is certainly to 
indulge in capricious administrative behavior, per- 
haps foolish and surely irresponsible. 
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A review of the research literature in the area 
of international edi cation programs reveals only a 
void of frustrations. In general, former research 
projects have attempted either to superimpose 
standardized tests on foreign study programs or to 
employ instruments of measurement specifically 
designed by the researchers for individual pro- 
grams. The former elTorts proved unsuccessful, as 
the two components dii not mesh nicely. In the 
latter attempts, nonstandardized test^ were dem- 
onstrated too gross to measure the very sensitive 
indices in question. Ar the coup de graco to pro- 
gram administrators, research reports were uni- 
formly couched in arcane, statistical jargon, unin- 
telligible to the uninitiated. One could only expect 
that policy decisions concerning the goals and their 
implementation in foreign study programs were 
necessarily based on fragmented, questionable in- 
formation. Research on off-campus domestic pro- 
grams appears even worse: it seems nonexistent. 

Assessing the mtellectual development in a cer- . 
tain area is not an impossible endeavor. With care- V 
ful i)re and post testing, cognitive change on 
specific dimensions may be measured by using 
well-defitied criteria. Today's educators face a 
common dilemma and challenge in another area of 
inquiry, where information is scarce. The need 
exists for a coherent method of collecting, comput- 
ing, and analyzing information about the changes 
in the affective domain of students who study off- 
campus, either "overseas** or ''domestic.*' This 
project is attempting to do just that. 

II. Development of the Instrument 

Here at the Center for the Study of Higher 
Education, a research team has undertaken to de- 
velop an instrumcikt of assessment. Entitled the 
Individual Opinion Inventory (lOI), thd. experi- 
mental instrument is presently in the qtv^elop- 
mental stage, about to enter phase II. De&i|ned to 
monitor and analyze changes in students' attitudes 
and character development affected by study off- 
campus, the lOI will ultimately become a descrip- 
tive but not a judgmental measuring device. 

A constant effort is made to differentiate be- 
tween evaluation and assessment. Assessment in- 
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eludes the eollection and anftlysis of data from 
which intelhgent, predictive decisions may be 
made. Evahiation, in ^^ontrast^ explicitly contains 
the superimposition of value-orientetl goals otito 
the resultant data. Those creating and administer- 
ing study programs endorvse value systems, whether 
overtly or covertly, which they impose on assess- 
rnent results. Descriptive^ data from assessment 
are transposed to a "good-bad" continuum by 
those re.sponsible for specific programs incorporat- 
ing precise objectives. Judgmental decisions are 
tho responsibility of the program's administrators, 
while our task is to aid in this process by providing 
logical and comparable data. 

In phase I of the development of this instru- 
ment (from May, 1912, to March, 1974 )» potential 
items for the instrument (lOI) were created by the 
research team in close rapport with knowledgeable 
persons in the field of international education and 
off-campus domestic education. Professionals from 
groups like the Regional Council for Interna- 
tional Education and the Great Lakes Colleges 
Association were consulted for guidance and advice 
at various times, as were experienced individuals 
from Antioch College, p]arlham College. Otterhein 
College, Kent State University, and Kalama7.oo 
College. At each stage of initial development, the 
lOI was reviewed and revised in light of the coun- 
sel received. 

c 

To complement advice from professionals, Dr. 
Hull interviewed individually students studying 
off-campus duriuii the 197:3-1974 academic year in 
New York City, Philadelphia, BoAofa, Cuernavaca, 
and Tokyo." The team believed that computerized 
data w^ere insufficient to furnish information per- 
haps extremely sensitive and that phrareotogy 
mutually comprehensible to both students a .d re- 
searchers was imperative. These direct personal 
interfacings afforded insight valuable to the phras- 
ing of the item questions plus sundry bits of sub- 
jective information which, othenvise, would have 
been unfortunately neglected. 

After a trial run and further revising, a pilot 
test of the instrument was conducted. As the lOI 
developed, it became more sensitive and more pre- 
cise, carefully monitored l)y (he team statistician, 
Dr. Jurs. In its present experimental stage, the in- 
strument was administered to three grc-ups of U.S. 
students from thirty-two (32) institutions of 
higher education. Form A was given in pre and 
post tests to a substantial number (N 378) of 
students who studied abroad at sixty-two (62) 
'^foreign" locations. Form B (N 110) was simi- 
larly applied to student groups studying in thirty- 
six (36) ofl-campus locations, like those in Phila- 
delphia and New York. Finally, a third student 
sample {N 246) was tested. This last group 
was composed of juniors in college who had re- 
mained throughout their undergraiUiate career on 
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their home campus. These students functioned as 
a baseline reference against which changes in the 
other two groups of students could be ascertained. 

In the analysis process, the thirteen (13) cate- 
gories within the instrument were subjected to 
both content and empirical validation. Specific 
items were correlated to their category to deter- 
mine if the item needed more revision. Care was 
taken to insure that each item tapped only one 
personal trait and that the dimensionality of each 
category on all three forms was the same. More- 
over, study programs known to differ in some basic 
areas were compared to discover if the category 
scores were sufficiently sensitive to disclose those 
differences. At the end of phase I, these measures 
are generally acceptal)le and very encouraging for 
an experimental research instrunfient at this stage 
of development. The reliabilities of the thirteen 
(13) experimental categories were computed using 
the coefficient alpha, a measure of internal con- 
sistency. 

III. Early Results 

At present, preliminary results from phase I are 
emerging from the data. While one hesitates to 
present initial findings lest they be interpreted in- 
correctly as absolutes, tentative results seem to 
indicate that several key factors do, indeed, relate 
to the afTective changes which occur in students 
studying oflf-campus. The follovvirig represent the 
most intriguing implications so far. 

First, the replies of students responding to the 
instrument were analy/.ed to ascertain if back- 
ground characteristics varied systematically with 
program outcomes. For example, it was discovered 
that students of diflerent academic majors re- 
sponded ditterently, with students in the humani- 
ties scoring category items significantly more 
favorably than students in the sciences. 'I'his pat- 
tern of differences of associations with a student's 
major field cf study occurred more frequently on 
Form A than on Form B or C. 

Second, associations of statistical significance 
were found between the thirteen categories of the 
instrument and (1) the student's present interest 
in the area of the ofT-campus study, (2) the stu^ 
dent's present amount of reading about that area, 
and (3) tfie student's present amount of coire- 
s])ondence with individuals living in the ofT-campus 
study location. On Form A, those students who 
gave the most positive responses (i.e., claimed the 
most ])ositive outcomes from their study experi- 
ence) also indicated a sustainec interest and in- 
volvement in the location of the off-campus study. 
These patterns emerged less frequently on Forms 
B and C. ' 

Third, the lenj^th of stay at the oiT-campus 
location was clo.sely associated \/ith the outcomes 
as reported by the students on Form A, but not 
always in the same direction. For example, longer 
stays ofT campus were related to higher scores in 
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categories like ^'Comparin^ and Observing Societies 
Different from One's* Own/' but they -were also 
related to lower scores in the cate^^ory of "Devel- 
oping Tolerance." Longer stays were also associ- 
ated with improved reported foreign language 
fluency and the use of the foreign language, as well 
as with a more positive image and a more positive 
evaluation of the instructional program at the off- 
campus study location. 

Fourth, statistically significant diTferences 
existed between category scores of students who 
studied In various locations throughout the world. 
In the five major geographical areas considered 
(Europe, Africa, Middle East, Central and South 
America, and (he Far East) the general pattern of 
responses indicated that students in non-European 
locations responded more positively on the various 
categories. 

Fifth, the presence of a ''host family'' or room- 
mate resulted in no systematic differences in the 
scores of the categories on F*orm A. The same re- 
sult occurred on the roommate category on 
Form B. 

. In brief commentary on these tentative find- 
ings, dif[ere*ices linked to the student's major field 
of ^tudy are not surprising. One might reasonably 
expect that those factors determining one's major 
could also influence changes which occur ilI the 
student's perceived affective values. Similarly, 
those students .reporting a high involvement with 
the area of their ofT-campus study, as measured by 
their present reading and correspondence habits, 
could be expected to rate their off-campus experi- 
ences quite positively. 

More unusual were results from the item con- 
cerning^ the length of stay at the off-campus loca- 
tion. The most positive student reported outcomes 
were from those who had studied off-campus from 
27 to 52 weeks. Interestingly, the second most 
positive time duration was that of ton weeks or 
less. One might speculate that those students in 
the latter group were highly motivated nod staved 
so briefly that the expected period of disillu- 
sionment never could have oi^curred. These two 
results would indicate that programs of one year's 
length and of 10 weeks or less (ix\, summer pro- 
grams or one month interim progran*s) are pres- 
ently the best opporkmih'es for positive affective 
change. By im])Hcation, (hose programs of one 
quarter or one semester might be too brief to per- 
mit an optimistic upswin^^ after a "down" period 
and too long to sustain an initial impetus of high 
personal motivation. As this project eventually 
plans to continue measurement at a two-year and 
four-year interval following a student's return from 
off-campus study, it will be extremely helpful to 
see if both time duration groups remain significant 
or if the "10 weeks or less" group proves to experi- 
ence imi^iediate impact only. 

Concerning the tentative results aj^ropos of the 
geographical location of the off-campus experience, 
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one would hypothesize that such findings would 
likely emerge. Logically, experience in a culture 
c|iTite similar to the student's own would probably 
affect less change than experience in a culture 
radically different. Thus, students studying in 
Europe indicated less favorable responses than 
those , staying in Central and South America, the 
Middle East, and Africa. These findings do not^ 
certainly, imply the abolition of study programs 
in Europe. Rather, these results ind^pate what 
kind of outcomes may be expected in students 
choosing various geographical areas. Further, de- 
sired affective changes cannot be divorced from 
desired academic opportunities. Obviously, the 
total impact of a program in Africa should differ 
from that of a program in Western Europe or New 
York City. Program directors arid those adminis- 
trators making policy decisions would surely profit 
in knowing the direction and intensity of affective 
changes which are likely to occur in specific pro- 
grams* 

Finally, tlie lack of systematic differences, to 
this point, based on the presence or absence of a 
host family or roommate is really not astounding 
after some consideration. Rather than the presence 
or absence of the two factors, the quality of the 
relationship between the American student and the 
host family or the roommate appears significant. 
In the former relationship, students of different 
majors had different degiees of success with their 
host family. In the latter instance, there is a cor- 
relation bet^veen the quality of the relationship be- 
tween the roommates and the major field of study 
of the individuals. Data will be clearer on the 
quality of the relationships in phase II. 

Again, one must caution that these initial find- 
ings are tentative. The lOI as a nicasiiring instru- 
ment is still in experimental development. Con- 
versely, these early results are certainly interesting 
and, on occasion, arresting and provocative. With 
a most recent grant from the institute of Inter- 
national Studies, the continuance of the project is 
insured until Spring,' 1976. 

The research team has learned a great ucal 
from phase I and, as. in any experimental study in 
a complex area, is now able to specify tliC precise 
needs and procedures of phase II. With the appar- 
ently successful development of the research in- 
stru nent in phase I, the task for phase II becomes 
the carefully controlled collection of data from a 
technically precise sample, for the purpose of rigor- 
ous program assessment. Accordingly, pre-post 
data during phase If will be collected in coopera- 
tion with six (6) institutions: (1) a state univer- 
sity college on the I^ast coast; (2) a state univer- 
sity college on the West coast; (3), a private liberal 
arts college in the Midwest: {4) W large program in 
cities in Denmark; (5) fwo branches of a U.S, uni- 
versity in Nairobi and Ghana: and (6) a well- 
known domestic study program in an East 
coast city. These locations mirror significant differ- 
eiiccs found during phase I and hence arc expected 




to be the locations of the most pregnant research 
validation efforts for the lOI in phase' II. Each 
site has been carefully selected because of its com- 
mitted ability to meet the requirements of the data 
collection and because of the presence of a highly 
qualified professional at the site to collect the data 
as specified. 

At the end of phase I, the lOI was sharply re- 
duced in size. Only those items which had been 
proved effective were retained. Post Foim A, the 
questionnaire designed for students returning from 
study abroad, for example^ was pared from 1S3 
iteips to 94. Thus, at the locations r.pecified aViOve. 
the procedure will be as follows with the rovised 
instrument: 

1. Pre tests of the lOI on Forms A and B will 
be administered to all students leaving the 
designated U.S. institutions for ofl-campus 
study between Spring, 1974, and Septem- 
ber, 1975, 

2. Form C will be administered to a randomly 
selected number (equivalent to those f^oing 
off-campus) of sophomores and juniors at the 
United States institutions in the Spring of 
1974, November-December of 1974, and 
Spring , of 1975> tp provide a baseline for 
post-affective changes at the sample United 
States institutions. This group wilt be used 
for comparative purposes, since the require- 
ments for a technically correct control 
group will most likely prove to be impossible 
to meet. 

3. Pre and post tests of Form A will be admin- 
istered to alt students arriving and depart- 
ing the two international, study centers 
designated above, and pre and post teats of 
Form B to all students arriving and depart- 
ing the domestic study center designated 
above (between Spring, 1974, and Septem- 
ber, 1975). 

4. A carefully selected representative sample 
of students at the two international loca- 
tions and the one domestic !ocation specified 
above will bo interviewed by the project 
director and associate to provide detailed 
case study analyses illustrative of the range 
and type of affective changes occurring dur- 
ing off-campus study. 

5. The data v 111 be analyzed during the Fall 
of 1975. 

6. The report will be presented March, 1976. 

In summary, the emphasis of phase II v/ill be on 
(1) rigorously and systematically collected pre and 
post data on the lOI for formal validation of the 
101 as a research instrument and (2) further 
and more detailed investigations of affective 
"changes" which are attributable to study off- 
campus, domestic and international. 



IV, Conclusion 
If the lOI proves successful, the advantages of 
its availability would be numero!!s. Practically, an 
assessment instrument of off-campus study pro- 
grams would probably be welcomed by those pres- 
ently involved in the organization and direction of 
such programs. While control of selection criteria 
is explicitly not one of the goalr of the lOI, pre- 
dictions of student outcomes would prove immea- 
siimbly valuable. High school counselors, under- 
graduate advisers, and all foreign language people 
could begin to plan and to advise according to re- 
liable information rather than according to guesses. 
Students could also know within certain limit£j 
what to expect of an off-campus program. - 

Second, those responsible for implementing off- 
campus study programs of specific natures would 
have an instrument capable of providing crucial 
information on which consequential decisions could 
be based. As an iHustrati ju, program administra- 
tors stressing fluency in a foreign language would 
know that the most beneficial results might be ex- 
pected from a constellation of specific factors. An- 
other program directed by a religiously oriented 
institution might want to devise a way to stress 
the development of tolerance and the development 
of the value system of the individual In both 
cases, those specific values described as objectives 
might be more effectively measured with the use of 
the lOI. The process of implementing goals would 
be indicated by the comparison of the predictive ' 
scores on the rneasurine instrument before the stu- 
dent's departure and the ultimate scores upon re- 
turn. 

Third, the lOI would make a sorttf into the do- 
main of educational acco.uitability. Federal and 
state governments, for example, have grown in- 
creasingly curious and aggressive in their demands 
for financial accounting and responsibility. This 
trend will rot be reversed in the future as higher 
education becomes more expensive, tax doUars 
rarer, and private contributions more ^elective. 
The golden age of higher education, symboUzed by 
the formerly glib professorial attitude toward 
grants, is now a legend. From legislators counting 
tax dollars to parents footing the bills to students 
stepping onto charter flights, the range of ac- 
countability is wide and its nature demanding. 

As the Carnegie Commission has so convinc- 
ingly dr-monstrated in many of its publications, 
assessment and accountability, now crucial con- 
cepts in education, will surely enter the permanent, 
professional lexicon. Thus the Individual Opinion ■ 
Inventory is designed for those involved and con- 
cerned with off-campus education. If traditional 
national boundaries dissolve and supranational or 
regional mentalities present new perspectives, the 
comprehension of the mechanisms of attitudinal 
change in students will become more and more 
significant. As the concept of a world view gains 
ascendancy, educators must afford students those 
experiences deemed most likely to be beneficial. 
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FOREWARD 

Herein is" to be found the report , on phase I of a ^very complex '^and [ 
difficult undertaking: an assessment of off-campus education prograjns for 
undergraduates of American colleges and universities. When this was first 
proposed, there was' a great deal of skepticisfo as to its chances of success. 
•At th? conclusion of phase I, there remains skepticism in certain specified 
areas - and there have been problems. Pit th^ chances of sj^ccess have been 
significantly increased. It is a project report that must be read in light 
of the fact that it is truly "in progress," but it is apprppriate to share 
^here we now stand as phase II has begun. . . . \ 

The project has been funded by the United States Office of Education, 
under the authority of Title VI, section 602, NDEA, Mrs. Julia A. P^trov, 
Research Chief. The Tokyo inteiriews were made possible through a compli- 
mentary grant from the Lilly Endowment, Inc., Dr. Landrum Boiling, Executive. 

In addition to the cooperation and ever present counsel of Mr6 . Julia 
Petroy, there are others whose efforts and assistance merit acknowledgement. 
Dr. Stephen G. Jurs , Associate Professor, Department of Research and Meassure- 
ment, serves tirelessly as the Research Statistician and Data Analyst. Dr, 
Leo D. T^onarrl, Associate Professor, Department of Educational Theory and Social 

f ■ ■ 

Foundations is Senior Consultant. Dr. Richard Stavig, Kalamazoo College; 
Dr. Irwin Abrams, Antioch College; and Dr. Ivan Putman, The State University 
of New York, have devoted many gratis h'ours of careful counsel. Mr. Henry 
Acres, formerly President of The Great Ijakes Colleges Association, and Mr. David 
Hoopes , formerly Vice President of The Regional Council for Internat ionai 
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[•^aucation, both contributed a major effort in .working to establish the 
projGct'3 design^as well as many of the items and expel^imental categories. 
In fact, the original ideas generated out of • conversations with Mr. Acres. 
, Individuals at most of the institutions represented by both of these groups 
have gone out of their way to assist in many ways. 

Dr. Walter H. Lemke, Jr., has joined the effort as Associate Project 
Director and is 'proving increasingly responsible as he pauses from his own 

career aii a French professor and accepts joint responsibilities for the 

\ 

quality and conduct of the effort. Mr. Marshall W. Davies and Mr. Duane E. 
Whitmire have provided doct^;al assistance in specific areas noted herein. 
Last, but surely not least, Sandy Willier, a public school teacher by 

day> has constantly performed ' the lonely task of typing afid retyping, again 
and again, the various revisions of the instruments and work sheets as well 
as this report. Surely she has proven her skill, patience, and good humor. 

■ In^short, many individuals have contributed. However, in the final 
judgments, I have no one to blame but me. We have all loarned a great deal 
about a very complex and important educational entity. There remains much 
to discover, but our most significant success, to this point, is the fact 
that we are now at the point wKere to thr; answers and hvmches of the 
theorizer and practitioner alike, we are now able to pinpoint the discerning 
questions. 

March, I97U 

■ V ^ - W. Frank Hull IV 

/ ' ^" Project Director 
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'^The-Mericaa Undergraduate , 
Off-Campus and Overseas: 
A Study of the Educational Validity 
of. Such Programs" 
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In the words of tVie Universal Declaration of Human Rights: 

Kduimtioa t^haXX be directed to the full dcvelopraerit of the 
hximaix personality v^nd to the strengthening of respect for 
human rights and fundamental freedoms; It shall promote 
understanding, tolerance and friendship among all nations, 
racial or religious groups, and shall further the activities 
of the United Nations for the maintenance of peace 

In light of such ideals, in these United States of America we find ourselves 
in the position of watching legions of young Americans each year travel out- 
side our iDOlitical boundries on study programs or on their own, yet we know 
very little about how such experiences affect them. We assume that they 
develop their cognitive skills - at least students in formal study programs 
typically present some certifj cation which is extrapolated into academic 
credit toward degree completion at the home institution, Whil^jbhere exists 
some discussion of how such credit should be ''evaluated" in the academic 
records, there is general agreement that the young Americans do increase 
their -cogaitive skills vhile abroad. 

But, education of the nature implied in the above United Nations document 
is much more than the mere acquisition of cognitive skills, as important as 
they are, A liberal arts education, at the coIJege levex, is a perspective, 
-not-a formula. I t-assurnes^-^s-^q-many-of the -philosophical- and~-theolog^ 
und'^rgirdings of the United States' societies, that the individual is unique 
and that he deserves to have his own potential developed to the fullest 
extent beyond the acquisition of cognitive skills. Education includes the 



-^"Universal Declaration of Human Rights," UTffiSCO, Article 26, 2 (19^48) 
of • "international Covenant on Economic, Social, and Cultural Rights," 
adopted by the United Nationa General AvSsembly I966) , especially Article 13- 



cievt'lov)nient of iatolloctual facilities aad moivil responsibilities in each 
individual. 

In fact, we kaow precious little of the impact of collegiate education 
upon the individual's affective values. Hovever, when we specifically 
consider the American student who studies away from his hone college or 
university for a period of time, our knowledge appears even less precise. 
What happens, in specific, to the American undergraduate who studies in Hong 
Kong, Nairobi, London, or Paris or who studies in New York City or Philadelphia? 
Beyond having been there and having studied with instructors not available on 
his honie cainpus in Ohio or Iowa, what differences are there between these under- 
graduates and those who remain on the home campus throughout their under- 
graduate career? 

As James M. Davis has admitted: 

Obviously we are working on faith because we really have very 
little evidence of what happens as a result of international 

educational eKperience* I see no reason to be quite so 

ignorant as we are now, having been in the business twenty 
years,^ 

He Is right. The need for accountability, which is becoming ^Increasingly 
pr'=>valent in higher education in the United States, should apply to off-campus 
, oducaMcTial programs, both domestic and international. 

Any researcher who sets forth to study "impact^^ is immediately confronted 
with a very complex task. Various research strategics exist'^ to meet specific 
purposes, but one must never underestimate the complexity of the assessment 



' *^Jamc:^ Davis, r.s quoted in All?n A. Michie, ed. , Diversity and 

Independence Through laternational Education (New York: Education and World 
Affairs, I967), pp. 70-71. 

^cf. fCenrieth A. Feldma^i, ''Research Strategies in Studying College Impact,*' 
A CT Research Report , No. 3^ (May, 1970). ' I 
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problems to be encouatered. Indeed, to study the student who leaves his 

home institution to go elsewhere for a period is a very difficult t^sk> for, 

as a monk of Froidmont reminded in the twelfth century; 

The scholars are wont to roam aroUad the world and visit 
all its cities, till much learning makes them mad; for in 
Paris they s(^ek liberal arts, in Orleans authors, at Salerno 
gallipots, at Toledo demons, and in no place decent manners. 5 



Ij The State of the Research Knowledge 

During the 1950's and 1960's higher education in the United States 
witnessed a major increase in the number of off-campus "overseas" (i.e. beyond 
the United States' political boundries) programs for students still in their 
undergraduate program. Along with an* increase in off-campus "overseas" 
study programs, there has also developed an increased interest in the assess- 
ment of such programs. In 1967? for example, the Federation of Regional 
Accrediting Commissions of Higher Education issued a /'Policy Statement on 
Undergraduate Study Abroad Programs," which read, in part: 

Study abroad is increasingly accepted as an important 
p^^ase of many undergraduate programs in American colleges 
and universities. Carefully planned and administered, 



"^Rc Iney T. Hartnett, Accountability in Higher Education; A Consider - 
ation of So me of the Probl ems o f .Assessing College Impacts (Princeton; 
.College Entrance Examination Board, 1971) » 

Quoted in John A. Symonds, Wine, Women and Song (London; Chalto and 
Windus, 1907), p* 17. 

6por formulation of this section, the project director is indepted to 
Marshall W, Davies, a doctoral candidate who worked on this project from 
its beginning through August, 1973, and who is now at the Office of the 
Provost, Antioch College. It should be noted that most of the research 
reviewed here concerns "off -campus overseas" programs due to the major 
lack of iiolid research on "off-cc.npus domestic" programs. 
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opporcunitiei5 for foreign study can add significant 
dimensions to a student educational experience. At the 
same time, the great diversity of programs poses serious 
problems for evaluation and control. 

The general literature dealing with students studying off-ca*npv.3 
^'overseas^' is sizeable. Most of it, however, has focused on students from 
other .countries who were studying in the United States, The remaining part 
of the literature, dealing with American students off-campus ''overseas," 
consists largely of descriptive materials of various individual study, 
program;'. 

There are, though, several significant studies which have attempted to 
methodically assess study off-campus "overseas" for American undergraduates. 
In thes-c studies the researchers have first determined what it was that off- 
campus "overseas" study £}:ould accomplish. This criterion has generally beun 
expressed in terms of the goals of the pat^tibular study program and/or in 
terms of what the researcher believed would bf^ an appropriate measure of 

\'suc^c_ess, , an increase in„ 'VorlteiaMdne^^^ in "dogmatism, „. 

etc. Instruments were then used to locate shifts on the criteria measure. 
Such studies con be conveniently, if somewhat roughly, divided into two types: 
those studies that made use of existing instruments to detect shift^ on the 
criteria measure and those studies that make use of instruments created spe- 
cifically for the particular research study. 

Considering first the studies which emphasized existin^^ instruments, a 
small group of Adelphi College seniors who went "overseas" were' studied by 



'As quoted by Allen 0. Pfnister, "General Evaluation of Study 'ibroad 
Programs Under the Au::pices of American Colleges and Universities" (paper 
presented at the meetings of the National Association for Foreign Student 
Affairs, Atlanta, Georgia, May 3, 1972), p. 6. Pfnister further notes 
that during 1972 in the bity of Madrid, Spain, alone, there were thirty 
established academic yeai^ programs and almost as many sumer programs. 
Over 1,000 Ameri':an students were expected in Madrid for the year, while 
number for the summer was expected to exceed 2,000. 
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EUizabeth W, Leonard in 1959 determine the extent to which they realized 
the stated objuctives of their sojourn,^ Beyond several instruments con- 
structed by the researcher, the emphasis was on standard instruments 
including the Allport-Vernon '^Study of Values, "9 and Adorno's ''Ethnocentrisra 
Scale," "f Scale," tMd "Political-Economic Conservatism Scale, ''^^ The 
instruments were Ghot:en because they were thought to measure different 
groupie of the objectives that had been established for the study program. 
In determining these objectives, each of the participants was asked to list 
hi'3 iadivLdual goals well before the sojourn began. The faculty likewise 
pi'epared a list of goals, and the student and faculty g<3als were later com- 
pared in a seminar. "The students listed their own goals under the faculty 
goalj, found a high degree of agreement and accepted them {the faculty 
goals) without major change, "^-^ 

Results were encouraging, as increases were found in "liberalizing 
attitudes" and in "cultural attitudes leading to international understanding 



There was a gain in foreign language scores, an increased knowledge of the 
geography of Western Europe, a reduction in political-economic conservatism, 
and a gain in "self perception." Unfortunately, the sample contained only 
fourteen students who had been matched on several variables rather than 
randomized. Pre- and post-tests were used; there was no control group. 



%li:^.ab''th V/augh Leonard, "Selected General diucation Outcones of a 
Foreign Travel and Study Program" (unpublished Doctoral dissertation, 
Pennsylvania State University, 1959). 

9 ^ 

^Gordon W. Ailpurt and Philip E. Vernon, Study of Values (Boston: 
Houghton Mifflin Co. , 1931). 

^^Theodore W, Adorno, The Authoritarian Personality (New York: Harper, 

i9^;^o), pp. 110-23. ' 

'^■''Leonard, op. cit., p. 72. 



Novortheless , thu^ early study does clearly indicate reason for research 
(mtuniijm in looking closely at the influence of off-campus "oversea^^' study 
prograins on the participants' affective value 

Nine years later in 1968 Eric P. Kafka utilized a different set of 
standai^d instruments on students returning from a ten-veek off-campus "over- 
seas" program. The entire sophomore class-*-^ of Justin Morrill College, an 
oxperimental college with a cross cultui'al focus within Michigan State 
University, was studied in an attempt to locate greater increases in ^world- 
mindednoss" among those students who had spent their summer "overseas" 
studying than among those v;ho had remained in the United States, 

In addition to Sampson and Smith's ""//orldmindedness >Scale,"-^^ Kafka also 
used the Rokeach "Dogmatism Scale, "-^^^ Prince's "Differential Values Inven- 
toiv>"*^^ and demographic data in an attempt to discover any Variables related 
to changes in "worldmindedness" regardless of overseas study. However, he 
-failed to -find any-variables related to a significant change in "worldmind- 



edness" nor v;as the increase in "worldmindedness" by the overseas study group 
large enough to^be. statistically significant. Kafka felt that the 'Vorld- 
mindedness S.^ale" wa^ possibly not a sensitive enough instrument for research 
on "overseas" study, ■'-^ 



12xhe sophombrO' class consisted of 208 students. Eighty-one v;ho 
studied "overseas" became the experimental group while the remaining 127 who 
spent the su:nmer in the United States became the control group. 

■^^Donald L. Sampson and Howard P. Smithy '^A Scale to Measure Worldminded 
Attitud»:s," The Journal of Social Psychology , ^45:99-106, 195?., 

^^^Milton Rokeach, The Open and Closed Mind (New York: Basic Books, 
I960), pp. 

^ :A ' 

-'-''^Kafka does not adequately document Prince's instrut;ent. 

Rric ?• Kafka, "The-Kffects of Overseas Study on Worldmindedness 'j^lcI 
Pp9^"r Selected Variables of Liberal Arts Students" (li/'ipublishod Doctpral 
tl^>erte.tion, Michigan rotate University, 19^>B), pp. 76-77, r^S-l63. \, 

I 



? 

Charles T, Smith, Jr. in his 1970 study of the Kalamazoo College 
"overseas 'V study prograjn went beyond merely looking for the influences of an 
"overseas" study experience as a whole. He attempted to llnK "changes" in 
participants' attitudes, values, and interests to specific characteristics of 
the "overseas" study program. Using the College Entrance Examination Board 
foreign language reading and listening tests, the Allport-Vernon-Lindsey 
"Study of Values, "■^'^ fe.lajjiazoo College's ovn Evaluation Form, and the Educa- 
tional Testing Service "College Student Questionnaire,"-^^ Smith found six 
program characteristics pr^^ctive of attitude, value and interest development 
(as measured by the above instruments). The two most powerful of these were 
"breadth of exposure to non-Americans" and "the presence of an American 
.\ subculture • " He further located more change in students who lived with 
host families than in students who lived in dormitories and more change In 
students who received instruction in English or a combination of English and 
the hose language than in students who received instruction entirely in the 
host language. 

Another study by Edward E. Morgan, Jr. researched the Regional Council 
fpr International Education's program in Basel, Switzerland. This three-part 



17 

Gordon W. Allport, PhiliJ) E. Vernon, and Gardner Lindsey, Study of 
Values (Cambridge: Riveri^de Press, i960). ^ ^• 

-^%]ducational Testing Service, "College Student Questionnaire" 
(Princeton; Educational Testing Service, I965). « ■ ^ 

^9charles T* Smith, Jr., "The Relationship of Progreun Characteristics 
of the Kalamazoo College Foreign Study Programs to Changes in Participants' 
Attitudes, Values, or Interests" (unpublished Doctoral dl^ssertation, The 
University of Michigan, 1970) • 

^^dward E. Morgan, Jr., "The American College Student in Switzerland: 
A Study of Cross-Cultural Adaptation and Change" (unpublished Doctoral 
dissertation, University of Pittsburgh, I972). 
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study focused on changes in partidft^ants ' values and attitudes as measured 
by the researcher, changes and change agents as perceived by the students, 
and adaptation to the "cross cultural experience*" The first part of the 
study made use of several "standard" instruments; the second part vas based 
on experinienter designed questions and experimenter conducted interviev{s, ' 
while the lai">t part used data gathered in both previous parts as well as 
additiofujl data from existing records, observation, 'personal knowledge ,"21 



and intervi 




In looking for differences between pre- and post-test scores on the 
Allport-Vernon-Lindsoy "Study of Values," the Rokeach "Values Scale, "^2 q^^^ 
the Rokeach "Dogmatism Scale," Morgan failed to locate any statistically 
significant differences, but explained this by suggesting that the use of 
measures of central tendency had overlooked significant individual changes. 
He contended that the sWfts that did occur on individual scores were 
"probably very meaningful. "^^ The second part of the study was conducted by 
as k i ng the v^" tur n i ng s tuden ts wha t ^ had - happenM „t QL_them * .__?y_o__h ighly s t rue - 
^ tured but open ended questions Were used, and the types of change and chp,nge 
ag/ nlo articulated by the students were systematically categorized. The 



rindj::£-: v.'^s the absen^^e of "academics" as a change agent. In reporting 




such Morg.m 



It ir, easy to discern that the academic component of the 
program did not make any noticeable impact on the students and 



^^Merghf^ spent nine months in Basel, during academic year 1969*- 1970 
obr-erving thf^ forty-five stud.^nVi that he studied. 



2%1ilton Rokeach, Beliefs, Attitudes, and Values (San Francisco: Jossey 
3a-.s, Inc. , I968) . 



-^Morgan, op. cit., p. ^l9- 
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if It is to be considered as a major component of the prograra 
it haj5 failed miserably. 2^ 

In the final part of the atiidy, Morgan developed a typology into which he 

could fit each of the Basel! students according to the way that they personally 

adapted to living and r>tudying in a foreign country. From this he concluded 

that the patterns of adaptation depended largely on the cultural conditioning 

that the student had bc^fore he arrived in Switzerland. 



'Aresearch project conducted by Harrison G. Gough and William A. 

McCormack is another that utilized existing instruments. Gough and McCormack 

did not set out to test any predetermined idea about education abroad. 

Rather, the purpose of their study was: 

•..purely exploratory- -to investigate different domains of 
testing and forecasting, and to see whether any promising 
leads could be uncovered which could then provide the starting 
point for a larger, longer, and mor^e definitive s,tudy.25 

Using a sample of fifty^eight students who had participated in the 19^5- ^ 
1966 education abroad program at the University of California at Bf.rkeley, 
Gough and McCormack based their criteria of performance "overseas" on four 
measures: peer nominations, directors' ratings, overseas grade point average, 
and each student's own evaluation of the worth of his overseas experience. 
The researchers then collected additional dala on their sample, administering 
a ten-hour battery of tests, consisting of seventeen separate instruments^^ 



^^organ, op, cit., p* 66. 

-"Harrison G. Gough and William A. McCormack, An Exploratory Evaluation 
of Education Abroad,'* Cooperative Research Project No. S-U'*0 (unpublished 
study, Univeiwit^ of California at Berkeley, I967L 

e.g.. College Vocabulary Te'^t (Gough, H.G. , and Sampson, it.. The 
College Vocabulaiy Test . Berkeley: University of California^ Institute of 
Personality Assessment and Research, 195^); McClosky's scales for economic 
and conservatism (McClosky, H, "Conservatism and Personality/' Amey can 
Vtical Science Review ^ 19^8, 52, 27-^5); Barron-VJelsh Ai^t Scale f/felsh, 
EKJ[C > Preliminary Manual: Welsh Figure Preference Test, rev, ed., Palo Alto, 
"^Rfornia: Consulting Psychologists Press, 1959) > etc* 
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moayurlng nvunerou.^ intollecbual and personality variables as well as 
"gathering available existiiig information. ' - .. 

The data were used in a variety of analyses, but of particular concern 
here is the section of the study that dealt vrith the prediction of success. 
Using their four, criteria of performance overseas, Gough and McCormack 
correlated these criteria with each other and with the variables that had 
been used in selecting the students foir overseas study. ^'^ The first three 
of the criteria were found to be significantly intercorrelated and were 
viewed as "three slightly different facets of an overall assessment of quality 
of performance, The fourth criterion--the student's own evaluation of 
the worth of his overseas experience--stood alone and was clearly an indepen- 
dent measure which Gough and McCormacK felt "should be studied... as an 
independent criterion. "^9 This study represents the first serious attempt to 
use the returning student's perception of what happened to him as a valid 
research criterion. 

Res.earch studies utilizing only specially designed instruments contain 
only two studies, but one of them is possibly the best known research on 
overseas study programs. This is the evaluation of the University of 
Delaware-Sweet Briar College junior year in France program done by Robert C. 
Pace in 1959^"^^ The^ heart of this study was a questionnaire designed by 



27 

'i.e., grade point average in language at application, overall grade 
point average at application, semester units of language study at application, 
and rating by a "selection committee." 

Gough and McCormack, op. cit. , p» 80. Ibid. 

^ Robert C. Pace, The Junior Year in France; An Evaluation of th(^ 
Delaware-Sweet Briar College Program (Syracuse; Syracuse University Press, 
1959^: . 



Kaoe which contained six subscales. that measure^ opinioas and attitudes 
which he felt should have been fostered by an overseas study experience 

. The sample of 500 former students was drraw-i^^ from all of the participants 
in the program between I923 and 1953 while a control group was drawn from 
among those who were students during this time but did not study in France, 
Comparisons made between the control group and the sample led Pace to conclude 

. that 't)articipation in*., (the study abroad) prograq^ makes a difference in the 

~ 'subsequent lives of its alxmcii/^^^ 

In a study done at Antioch College in 1968, Paula Spier established that 
it was possible to isolate predictors of success in overseas study. Using 
a sample of 536 students who had participated in the Antioch Education Abroad 
program between 1957 and 1966, Spier designed four instruments that attempted 
to measure a student's "performance overseas*' and several variables that were 
possible p'redictors of that performance. The "Judgemental Overseas Perfor- 
. raance Scale" ( '*Perf ormaiice Scale") was a subjective rating of each student by 
the'Te searcher on -the basis of the information available in each student's 
individual folder after his return from overseas. According to Spier the 
factors used to rate each student on the "Performance Scale" can perhaps best 

subscales were designed to measure: international, political, or 

-^governmental activities; activities relating to foreign culture; freer 

exchange between countries; the role of the United Nations; policies of the 
United States in relation to the United Nations and other • countries; degree 
of acceptance of people of other cultures, nationalities, races, and 
religions. 

B^This was not a random sample, but rather was a self selected sample 
which inoluded everyone who returned his questionnaire. 

33pace> op. clt., p. 68. 
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be, generalized as a corAbination of demonstrated achievement and 'graceful 
adaptation. "-^^^ The other three scales measured variables that Spier hoped 
would predict scores on the "Performance Scale." On the first of these, 
the "Judgemental Prediction Rating Scale/' each student was rated by the 
researcher "based on all the information available" in the student folder* 
The "Academic Prediction Index" was based on the student* s grade point 
average, mid the "Co-op Prediction Index" was determined from the ratings 
of the students by their employers during participation in Antioch 's regular 
extramural work periods. The ratin^,s on the "Performance Scale" were 
correlated with the ratings on the other three instruments, and the results 
--^indicated that all were significant predictors of overseas success. Addi- 

. tional findings were that sex, year of study ( i.e sophomore , junior, etc.), 

• ' ' ■ - - .... ^ ■ ■ ' ■ 

and country of study35 were not predictors of success. 3^ 

Dividing previous research into the two categories above -helps to high- 
light one of the basic problems of researching "overseas" study - instrumen- 
tation. In discussing the results of his work, Erich Kafka pointed this out 
when he said: 

V/hile seeking appropriate instrumentation in the vague field 
of attitude change the researcher has to choose between 
standardized tests which are of proven quality but have not 
yet detected cliange from cross-cultural exposure, or locally- 
devised tests in which the reliability and validity are 
questionable . 37 

. . \ 

3^^Paula Spier, "Predictive Factors in Selection for an Overseas 
Study Program" (unpublished study, Antioch College, I968), p. 36. 

35There was one exception: those students who studied in Great Britain 
had a significantly higher "level of performance" than those who studied in 
other areas . 

•^^'Spier, op. cit. ^^Kafka, op. cit., p. 121. 
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MlJiOUKh i^ome renearcherc have attempted to check the reliability, and \ 
V'Ll jdiiy of t.hei.r "local" instruments, these checks have been far from 
c(wpioto. 

In suiTimary, research-on American students studying off-campus "overseas" 
is far from complete. Noteworthy studies in this area are comparatively few 
in number, 39 a|.though there have been some interesting^ results . Evidence 
hav. been found, for instance, in^^i^cating that success in "overseas" study may 
be predicted for certain individuals,^*^ Many studies, to be sure, have 
yielded primarily "no significant differences." 

In general the participant ' s/own perceptions, however, have not been 
considered as part of the resec^rch criteria. The students^ ajd through them 
the programs, have usually been measured in terms of what l^ixneone else thought 
to be appropriate. The Adelphi students in Elie.abeth Leonard's study had an 
opportunity to influence the goals of thej.r program, but they chose otherwise.^^ 
In his study of American students ini Switzerland, Edward Morgan did use 
otudent interviews to determine what type of change had taken place in students 



Spier made a reliability check of her "Judgemental Overseas Performance 
Scale" by correlating her ratings of sample of the students with the ratings 
made by another individual of the same sample (Spier, p. 38). She used a 
similar process to check the reliability of her ^'Prediction Rating Scale" 
(Spier, pp. 3^^-35). Smith attempted to validate returning students' self- 
^ratings by correlating the results of the self-rating wit>. the results of 
other individuals who rated the students (Smith, pp. hl-^cf) . 

' 39There are, for instance, far more -studies dealing with "foreign 
students" studying in the United States than with Americans studying 
overseas. ^ * " 

^^^cf. Gough and McCormack, op. cit.; and Spier, op. cit. A study 
presently in progress under Dennison fsTash, Professor of An't^ropology , 
University of Connecticut, on American students who participated in the 
University of Connecticut's junior year in France program during I97O-I97I, 
seems likely to add significantly to the research knowledge presently avail- 
able and should, be notea here. . 
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O ^ ^^-^Leonard, op. cit. 



and what ohaoge ageots were, but student r iponses were not used as a 
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criterion of success. Only in the Berkeley study was the perception of 



the student used as a part. of the criterion of success • 



II. This Present Study 



In the specific project reported herein: 

^"it is a5i;umed that the ultimate gdal of international exchanges 
is to contribute to friendly and peaceful relations among peoples 
of the world, but that many more immediate goals relating to 
teeJinical cooperation, changes in institutions, success iri 
academic training, increased kns?v;ledge about foreign cultures, 
preparation for a useful career, readiness to cooperate in 
international undeirtakings, etc. , may* all requir,e consideration.^ 



* 

\ 



The task* for this" project was thus to identify the specific goals wought by a 
group of quality ^ off- campus study program directors having much experience 
aqd to develop ^n appropriate instrument to assess whether o^^not the student 
participants perceived these goals as having been 'aetualized within - themselves , 



In all of this, a crucial distinction needs ;bo be remembered: A ssessment 



refers to the act and process of studying qualitatively and. quantitajtively a 
particular event or 'series of events upon an individual or individuals. 
Evaluation 'is the act and process of taking the data and concepts discovered 
in assessment and of.. adding a value judgement to that data. For example, in 



hp ^3 

^^Morgan, op. cit. j . Gough and McCormack, op. cit. 

^^^^Otto Klineberg, ^'international Exchanges in Education, Science, and 
Culture; Suggestions for Research,'' International Social Science Council 
(Paris: Mouton and Co., I966), pi 11. 

^"'^'Qualiby, " he r^j meant', progk^ams and their directors generally 
• .recognized among internutional study abroad programs and domestic off-campus 
programs to be well planned and ejxecuted . Thus "quality" programs are those 
where it is believed that the participants will be experiencing the "best" 
1 n^ff- campus education. 

ERIC 



15 

aa cii^sessm^nt study one might discover that $870 of the sample population 
studied presently report accepting professor X's theories or report having 
developed' a strong like for French wines or report having never entered a 
library or report having rea^ ^ Hnr^l^ during the year or report having only 
talked to other Americans overseas. When one begins to make statements 
implying th'2 value or lack thereof, good or bad, on any of that data, one 
has moved to the level of^ an evaluation statement. 

It should be perfectly clear that the present study is an assessm ent 
study, where the goal is to produce particular data on specific study experi- 
ences in both a "macro" and a "micro^* sense. Wien the dat?^ are produced, 
then and only then will it become the task of various educational leaders - 



includ ing the _djjtve^ctors^ programs - to make a judgement as 

to the ^value" of. the programs which set out to accomplish the spec^bii^c^ goals 

for which assessment is being attempted in this present multi-phased research 

project. , 

In developing an instrument for this assersment task - an instrxament 

^ which v;e have chosen to call the ^'individual Opinion Inventory,'' hereafter 

referred to as the "lOl" - jthe atten^pt has been made to encourage, if not to 

force, individuals knowledgeable and highly respected in the profession of 

"off-campus" educational programs to specif^^ not only the precise formal and 

informal goals of their programs but also the visible effects of the off -campus 

study that they view in deciding which students have had a "good experience*' 

in contrast to those who have had a ''poor experience." This was accomplished 

through a series of indepth interviews with personnel at various institutions 

♦ 

, associated with the Great Lakes Colleges Association and the Regional Council 
for International Education. It ig to be stressed that interviews were only 
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conducted witJi persons judged to be of superioi^ knowledge and quality in the 
opinion of the cooperating associations. 

Because of the complexity of the task, the research team thought a 
"]yre pilot testing" of the 101 would be helpful in order to conduct fuj^ther 
revisions of the instrument's items. The pre pilot was conducted between 
October 1, 1972, and November 30, 1972, at the Great Lakes Colleges Associa- 
tion institutions and especially at Kalamazoo College through the cooperation 
of Professor Richard T. Stavig. Only students who had returned to the home 
campus from an '^of f-cajnpus overseas" program for fall, 1972, were_sampled^__. 



Thi,s_i^isting-i'esuii:ed"iTT a revision of the lOI during January > 1973. 

Various assumptions and item wordings were then checked by the project 
director with students in the process of ^'of f-cajupus" education at the 
following locations; Bogat a, Columbia; Cuernavaca, Mexico; Philadelphia, 
Pet\nsylvania; New York, Nov York; and Tokyo, Japan. Further revisions were 
made* 

Three forms of the lOI were under development: 

Form A, for students returning from an off-cairtpus 
experience outside of the political bov-ndaries of the 
United States 



'^In specific, personnel at: Antioch College, Dr. Frederick Klein, 
Paula Spier, Dorothy Hyatt, Dr, Irwin Abrams; Earlham College, Dr. Lewis 
Hoskins, Dr, Richard V7oods; Kent State University, Dean Thomas R, Knipp, 
Dr. Roy Wenger, Dr, Charles F. Kegley, Dr. Sam Biedler; Kalamazoo College, 
Dr. Richard T. Gtavig; Otterbein College, Vice President Roy Turley. From The 
r»reat Lakes Colleges Association, President Henry Acres and Mr. William , 
Petrok and frotri the Regional Cotineil for International Fducation, Vice 
ProiUdent David lloopcs, provided endless counsel. Goals were stated and 
ront^led, and items v;ero developed and then revised between May 15, 1972, 
and October 1, 1972. Dr. Ivan Putman Jr,, The State University of -New York, 
'die a iKic xjrovided counsel througliout. 



United StatiFT- Political bomdaries of the 
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^' students in their "innir,." 
participated in of f-cLpis 
-.een Ma.h and Septe.e. .,.3, data eoneeted^7...., 
ccpxeted .t.n. f.. ..dents .ho had ..died . 3i.t..t.o^.Wi.n 
looations" (of. Appendix A), at thirtv-six "a 

C) ... -'^^^^^^^^ l°=^t,ions"(cf. Appendix 

i^j, oad represented thirfv Urr. - 

the U n , . -^t.tutions of post secondary education in 

the United States (cr. Apuendix P^ tv, ' 

-TT— --^-"^-^'-^^^^^^ 

Perm A, on Form B, and 110 on Form C. 

^ " - -entuall. test ..dents ' 

prior to their departure fnr "nfr ^ 

™=«ately follc^in, their 
off-=mpu,, ,tudy, two yoara after their ■■o«-o^„„3" ,t, . 
,r,„, .„ . „ , ^'""y' foor years 

afUr the.r off-c,™pu." study. s™ple= of students at th« "h ■ 

xrc. Which those students in the study goin« "off - 

; ^. udy going off campus" come - Will be used 

a^basexxne for con.parative purposes>8 

t ^ " '"^-'-^ - - - ^ report Of an e^eri- 

-J .ssess.ent in progress, .hat follows are the results, conclu- 

sions, and findings of the first phase i . 

I ' experimental development of 

tn. lor as an assessment device to thi^ r.^^ • . 

A great deal of work 

stiiii remains . 



K..ic„.x"ciut.f Li-Lie^ ?^:„2 r CoUe«es .ssoo.at.o,., ,„d 

"niv...ty Of Oa.for„ta through theX\-,-Vo^^--J-ted^- 
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III. Instrumeat Validity and Reliabillty ^9 

The psychometric properties of the experimental categories of items on 
the lOI v^ere analyzed through several approaches. The primary n^pthod of 
analysis was to iaspect carefully the number oT ^respondents who selected 
each of the posi^ible response options. This analysis indicated which items 
were answered in a variety of ways. Items which W'3re answered the same way 

by the vast majority r."" respondents were of litt^Le use in dif f ere n titatin g , 

students who had positive or negative off-campus experiences, 

A second analysis was the item-to-category total correlations. Correla- 
tions were considered adequate when they were positive and significantly 
different frcxn zero, /or the present sample sizes, this wouldmean that the 
correlations would have to be approximately ,20 or greater. Items that "L 
not have correlations with category totals of that magnitude could be 
suf:pected to not be internally consistent with the other items on that par- 
ticular category and hence would warrant revision or deletion. 

The reliability coefficients which were computed for each of the cate- 
gories of items were coefficient alphas, a measure of the internal consistency 
of the items in each category. It was hoped that the size of the r^l:*ability 
coefficients would be at least ,70 so that individual scores could be inter- 
preted as being moderately :ccurate. Reliability coefficients less than this 
would suggest the need for reconsideration of some or any number of the items 
grouped within a particular category, ' . 

Other analyses included analysis of variance where the differences in the 
means of groups of 3tudents were determined not ta be a function of chance. 



^-^Primary responsibility for this section ^7as assumed by Dr, Stephen G, 
Jurs, Associate Professor, Educational Research and Measurement, The 
, * arsity of Toledo. 
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In c)ther words, groups that were suspected to differ on a particula 
were compared to see whether the differences were reflected in the category 
scores • Categories that consistently failed to reflect those differences were 
judged to wan ^.nt reconsideration. . 

n 

A final set of analyses was common factor analyses on Forms A, B and C. 
The purposes of these analyses were: (l) to establish the interrelationships 
among the categories of the form, and (2) to see whether the patterns of 
j^nterrelat^ * ' 

A summary of the results of these analyses follows. 

A . Responses to the Separate Items and Item Total Correlations 

The frequency counts of responses to each of the items* on Forms A, B and 
C appear in Appendix D. It can be seen from these data that some items were 
more effective than others in terms of identifying the various ways in which 
the students perceived their off-campus experience. When the stud^p^ were 
in great agreement on items, it was decided to delete those items for the 
subsequent phases so that respondents would have fewer items to deal with 
and thus be better able to concentrate on them. 

The item-to-total correlations were especially important in terms of 
identifying items that did not tend to measure the same trait as did other 
i+'.eins to which it was logically related. Items with negative or close to 
zero correlations will be c\illed out for subsequent phases so that respondents 
will only need to deal with those Items which have been shown to be both 
logically and empirically related to the construct being measured. Inspection 
of the correlations wViich appear along with the response frequencies indicated 
that at least five and frequently many more than five items in each category 
had sufficiently high correlations to warrant tneir retention in revised lOI 
forms for Phase II of the projects 
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B« Reliability Coefficients 

The coefficleal alpha reliability coefficieats for the category scores 
of Pf>rms A, B, and C appear in Table 1 . .As is clear from these coefficients, 
the reliabilities of the experimental categories varied considerably. There 
was a general trend for decreasing magnitude of these coefficients from Forms 
A and B to Form C. Although many of the coefficients were substantial, more 
of theM were inadequate. It is possible to estimate with the Spearman -Brown 
formula how much each of these exyeriiuental categories wovdd need to be 
increased to reach acceptable reliability of .7 or .8. Clearly the required 

increases are too great for an instrment already too long. 

> 

C. Analyses of Variance 

Significant differences between groups of subjects on the experimental 
categories also help to establish the construct validity of those category 
scores. A large number of such analyses have been performed. These 
analyses provide, to a great extent^: the res\tlts of the pilot study of off- 
cajnpus programs. These appear in the following section of this report. When 
interpreting those differences, remember: to the extent that hypothesized 
differences between groups of subjects can be confirmed empirically, the 
construct validity of the categories has been established in part. 

D. Intercorrelations of Categories and Criterion 

Other analyses included the intercorrelation of the categories. Tables 
II, III, and IV indicate those correlations and the correlation of the cate- 
gory scores /ith a set^ of criterion items which define a positive off-campus 
experience (e.g., was your off-campus program the best part of your college 
program?). • 

ERIC . - 
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Table I 

Coorflciont Alpha Reliability Coeffiolents 

X Category Form 

v. ■ ^ — C 

Developing Tolerance .73 ,85 ,60 

Feelings Directed toward the Home 

►Institution .53 .32 



Social Interaction with those of a 

Culture Distinct from One's Own .i+3 ' .55 ' ,2h 

Kxperiencial Living. with and within a 

Host Family Structure .97 

Experiencial Living with a Roommate ^ .5I+ .69 .00 

Comparison of Societies Distinct from 

One's Own ,1+6 .ko ,38 

Observation of Society Distinct from 

OaeVs Own .I+9 .I43 ^qO 

Instructional Program Distinct fran 
that Available at the Home 

Institution .51 .il6 .81 

Appreciation of a Culture Distinct 

from One's Own ^ .55 .ll3 .00 

Development of the Individual Person .85 .8U .75 

Language Competency - Comprehension .80 

Language Fluency .79 

Language Use .28 
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/ The correlations for Forms A, B, and, C range widely and hence require a 
j^ore parsimonious description before interpretion. Consequently factor 
analyses were performed and are reported below. The corrections with the 
criterion scores were not uniform. That is, many of the experimental 
category scores which might be expected to be potent predictors-^of the 
criterion were not imbstantiated empirically. For Form A, the experimental 
"catcBory, Comparison of Societies Distinct from One ' s Own, was the best 

_pr odictor. For Forin B , the best predictor ^of this criterion was Social Inter- 



action with those of a Culture Distinct from One's Own, and for Form C> 
as would be expected, the best predictor Vas the attitude toward the category. 
Feelings Directed toward the Home Institution, The large number of non- 
significant predictors sheds some doubt on the predictive validity pf the 
experimental category scores. 

E. Factor Analyses 

The suiTuaary of the results of the factor analyses on Forms A, B, and C 
appear on Table V. The factor analyses determine the ur]derlying dimensionality 
of the matrices of correlations among the experimental category scores. The 
program used to calculate these results was the BMD03M program which performed, 
a principal axis^olution with a varimax rotation. 

The analyses yielded two factors on Form A but only one factor each on 
Forms B and C. These results suggest that the experimental categories of 
the pilot lOI did not measure distinctly different traits. Instead, responses 
were moi^ on a global basis, hence th(^ subscore totals did not, at least in 
this analysis, demonstrate the construct validity that might have been 
anticipated. 
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F . f>ui^\mary ' 

In summary, it can be said that the pilot lOI Form A performed somewhat 
bt^tter .than did Forms B and C. Some of the reliabilities of the experimental 
category score.s Wfire lower than might have been anticipated. Factor analyses 
indicated that the dimensionality of the experimental categories was less 
than was anticipated. The correlations of the items with the corresponding 
category totals, .however, identified a large number of individual items that 
did perform adequately. In light of these factors, the 101 will be able, to 
, be shortened (for subsequent phases) to include^-^ortly those items; with pre- 
dictability* The experimental categorical analyses are unwarranted as the 
assessment task can now clearly be better handled oh an item by item base. 
In yhort, phase I hacj located multiple appropriate and tested items in each 
of the areas of the experimental categories and the experimental categories, 
themselves, can be, deleted from subsequent phases*50 



A study of the off-campus programs of Kalamazoo College done by 
Marshall W. Davies provides additional validational data for the lOI. . Davies' 
study found' that per$ons who had highly positive off-cojnpus experiences 
scored significantly better than students' with poor off-campus experiences on 
the Appreciation of a Culture Distinct froin One's Own and Development of the 
Individual Person categories, but significantly lower on the Feelings Directed 
toward the Home Institution category. Davies also found that positive off- 
campus experiences could bt- predicted-less well by SAT verbal scores than by 
the lOI categories. 
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IV. Interpretation of Findings^ ^ 

This ^:ecbion points out the sigtiif icant differences between various 
groups on the experimental categories and the direction of the' relationships .■ 
For a more complete description » the reader is directed to the appended tables. 

A. Fo rm A 

1. Length of stay at the off-campus location . Considering the relationship 

between the length of stay at the off-campus location and the experimental 

categories studied within the lOIj the following experimental categories were 

sigjfii'ficantly^ related: 

Social Interaction with those of a Culture Distinct from One^s Own 
Language Use 

Instructional Program Distinct from that Available ^at the Home Institution 
Appreciation of a Culture Distinct from One's Own / 
Observation of Society .Distinct from One's Own 
Experiencial Living with and within a Host Family Structure 
Language Fluency 

Language Competency - Comprehension 
Feelings Directed toward the Home Institution 
Development of the' Individual Person 
Developing Tele x^ance 

In other words, a direct association occurred bet}/ireen the length of stay at 



the off-campus location and the above experimental categories. For examplj, 
the longer an individual student stayed off -campus the more he was likely to 
report he had interacted with others from the off-campus'^area, used their 
language, and developed an appreciation foi? their cultui'e and mores - which 
is a reasonable expectation. 



si 

^ Responsibility for this section ^was assiu.ed by Dr. Leo D. Leonard, 
Associate Professor, Educational Theory and Social Foundations, The 
University of Toledo. 
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Tb this point, colleges aad universities concerned about the length of 
stay off-campus should recognize that the greatest benefits, as perceived by 
students, from extended off-campus stays can be expected to be derived within 
the affective areas listed. It would appear that those items most influenced . 
by length of stay off-campus were those that we would hr.ve hypothesized at 
the beginning of our study. Taking the categories of Experiencial Living 
with and within a Host Family Structure and Instructional Program Distinct 
from that Available at the Home Institution as examples, it appears obvious 
that the longer an individual stays off -campus, the more he will interact 
with others, use their language, and appreciate their culture. 

Variations in length of stay did not increase one's language fluency, 
observations of the foreign society, development of tolerance or attitude 
toward one's host family or home institution. Length of stay had less relation* 
ship with a student's comparing a foreign culture with his own and had 
virtually no relation to attitude toward one^s roommate. The reader is directed 
to the tables in the appendix to see how long the students considered the most 
beneficial length of time to spend off-campus. 

It must be remembered that these results represent a stiident^s perceptions 
of change and change agents. This kind of source of information has certain 
advantages and limitations, which will be discussed later in the section 
entitled General Conclusions and Implicatit>ns* 

2. Major field of study of participant . Individuals with different majors 
differed significantly on the following four categories: 
Language Use 

Observation of Society Distinct from One's Own 
Appreciation of a Culture Distinct from One's Om 
Developing Tolerance 
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These findings seem to agree with hypotheses commonly held by program 
directors and researchers. It would also appear that students outside of 
the social sciences and hximanities see themselves as equally ade^t a*^ other 
majors in appreciating a foreign culture and in competently using its 
language, 

3. Extent of previous travel by participants . Individuals reporting various 
levels of previous travel differ^ed significantly on the following four 
categories; 

Social Interaction with those of a Culture Distinct from One^s Own 
Appreciation of a Culture Distinct from One's Own 
Language Use 

Instructional Program Distinct from that Available at the Home Institution 
The implications of these findings are as one might have expected. 
Previous travel may provide sophistication in forming attitudes about one's 
program of study, the culture visited, and tiie use of a foreign language. 
Surprisingly, the particular amounts of previous travel had little association 
with the perceived development of the student. Similarly, th'^ categories of 
Instructional Program Distinct from that Available at the Home institution, 
Experiencial Living with and within a Host Family Structure, and Experiencial 
Living with a Roommate seem to have less affect on the well traveled individ- 
ual. We might hypothesize that these students view themselves as already 
tolerant and pernaps knowledgeable of the host culture before d^^parture. 
The data, however, do not caapletely clarify this issue, at this point, 

k. Participation in previous off-campus study programs . This section 
considers the effect that other off-campus prop^rams , in which the student 
had already participated while in high school or college, had in influencing 
the student. One must not forget that various degrees of time lag affect 
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the conclusions tentatively reached in this section* 

As no systematic differences were located, one might speculate that as 
time passes and the student^s specific perceptions blur, myriad variables 
intervene to cloud initial opinions, or that the college student is at a 
developmental stage that is uncorrelated with his past high school experiences 
off-campus or overseas. 

Previous residence of participant . Her§ we consider the previous 

residence (rura]., urban, suburban) of the student, and how it may relate 

to the other categories. Two categories showed significant results: 

Feelings Directed toward the Home Institution 
Development of the Individual Person 

The interpretation of the group means listed in the appendix indicates that 

urban, suburban, or rural residence - in that order - affects a student's 

perception of those change factors measured by the lOI. On the above two 

significant variables, students from nxral areas judge their home institution 

more negatively and score lower on the Development of the Individual Person 

category than students from urban or suburban locations. 

6. Present correspondence with off-campus location individuals « This section 

examines the direction and significance that the". lOI experimental categories 

have with a student^s present correspondence with ^acquaintances made during 

his overseas study program. These categories proved significant: 

Social Interaction with those of a Culture Distinct from One's Own 
Appreciation of a Culture Distinct fron One's Own 
Language Use 

Instructional Program Distinct from that Available at the Flome Institution 
Observation of Society Distinct from One's Own 
Feelings Directed toward the Home Institution 
. Developmont of the Individual Person 
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As might be expected, social interaction was directly related to the 
artiomt of pre.sent correspondence reported. Those persons with the highest 
levels of correspondence tend to have the most positive patterns of response 
to the aforementioned experimental categories, 

7* Pre sent rea ding by participant of off ^campus material s. The present 
reading level of materials from and about the off -campus area were signifi- 
cantly related to the following experimental categories: 
Appreciation of a Culture Distinct fron One's Own 

Instructional Program Distinct from that Available at the Home Institution 
Social Interaction with those of a Culture Distinct froci One's Own 
Observation of Society 'Distitict from One's O^n 
Feelings Directed toward the Home Institution 
Language Fluency 

Development of the Individual Person 
Language Use 

Lxperiencial Living with and within a Host Family Structure 
Language Competency - Comprehension 
Developing Tolerance 

Comparison of Societies Distinct from One's Own 

Students who perceived themselves as having the most appreciation of a 
"foreign culture," .^jtrongest instructional program, keenest observation of 
society, and high frequencies of i^oclal interaction continued to read the 
host culture's lite.'ature. 



8, Presert iaterest of participant in off-campus area . This analysis is 
similar to that above which asked the student to reepond concerning his 
present reading of foreign materials and corresponaence with off --campus 
foreign acquaintances. Significant differences v;ej;e found in the following 
experimental categories: 

Appreciation of a Culture Distinct from One's O.v^n 

In::truetioaal Progiv'im Distinct frotn' timt Available at the Home Institution i .* 
Observation of Society Distinct from One's Own 

Social Interaction with those of a Cultujre Distinct from One^s Own 
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Development of the Individual Person 
fjanguage Fluency 

Feelings Directed toward the Home Institution 
Language Use 

Language Compet-eney GiOTprehension --• - « - — 

Developing Tolerance 

While, nothing astounding emerges here, these comparisons support the 
construct validity of the lOI. Personii describing themselves as still 
interested in the off-campus location also responded most positively on the 
above categories. 



9, Geographic location of participants . The following categories were signi- 
ficantly related to the geographic location of the off-campus study program 
(Europe, Middle East, Africa, Far East, South and Central America): 

Instructiotial Program Distinct from that Available at ' the Home Institution 
Social Interaction with those of a Culture Distinct from One's Own 
Language Use 
Language Fluency 

However, the means data analyzed by continent of off-campus study indicated 
that non-European locations can be expected to have produced more affective 
change as perceived by the students than European study locations. 



10^ Presence of a host famil y. The following experimental categories differed 

systematically with the presence or absence of a host family: 

Language Competency - Comprehension 
Language Fluency 

Appreciation of a Culture Distinct from One's Own 

Social Interaction with those of a Culture Distinct from One's 0\-:n 

Observation of Society Distinct from One's Own 

Presence of a host family was positively related to development of the 
student's language competency and appreciation of the ^'foreign culture/' 
These two factor^ii - language proficiency and awareness of the foreign culture 
arc precisely goals and objectives which many program directors have estab-i 
lished and endorse* 
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' t'urprijvingly, tho host family's presehce seems to have little relation 
to tho individual's perceived personal development, his ability to compare 
two ^socie ties, or his use of the foreign language. 

11. Presence of a roommate . There were no significant relationships identi- 
fied between the presence of a roommate and the experimental categories on 
the lOI. In light of traditional, subjective opinions, the absence of 
correlated findings may seem unusual and unexpected. One might hypothesize 
that the presence per se of a roommate is not as crucial as the- quality of 
the relationship between the two peers. 

12. Assocation of participant with another religion . No significant rela- 
tionships appeared from that data l^etween the student ^s own religion and his 
interaction with people of another religion, 

B. Form B 

As Form B was adminiotered to students who experienced off -campus study 
programs within the confines of the United States, the Experiencial Living 
w^th and within a Host Family Structure and foreign language categories were 
obviously omitted from this form* 

Length of stay of participant at off-campus location > None of the 
categories on the lOI proved significantly correlated to the length of. stay 
of the student at his off-cajnpus location. One might speculate that the 
programs where the present data were c'ollected were not sufficiently varied 
in the length of stay to provide such relationships. 

2, Major field of study of participant . Only Feelings Directed toward the 
Home Institution as a category correlated with the major field of the student 
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participating on an off-campus, national study program. Such a finding seems 
to indicate that the student's major does relate to his opinion of his home 
college or university. From the tables of means it would "appear that students 
majoring in the humanities and the social sciences have the most positive 
responses to the home institution. . 

3« Extent of previous travel by participant , No findings of relationships 
between the extent of prior traveling the student had done and the other 
categories on the lOI emerged. While some differences were shown on Form A, 
no such correlations appeared on Form B. data* 

h. Participation in previous off -campus study program . No category proved 
titatisticaliy significant when correlated with any previous experience in 
off-campus study programs. This is of particular interest in light of the 
ntimber of Form B students (N = 2^) who had been on previous off-campus 
study experiences. 

Previous residence of participant . Three categories of the lOI emerged 

significantly related to the type of previous residence (rural, suburban, 

urban) of the student doing off -campus but national study. These were: 

• Developing Tolerance 

Feelings Directed toward the Home Institution 
Appreciation of a Culture Distinct from One';; Own 

The more positive responses on the above categories were given by students 

who had previously resided in an urban area. 

6. Present correspondence with off-campus location individuals . Present 
levels of correspondence between students and individuals from their off- 
campus location were not systematically related to the responses on the 
experimental categoties. 
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Prei^ugb reading by participants of off-cajnpus materials . No significant 
differences appeared in this, tmalysis • 

C. Fonn C 

Form C was administered to students who did not experience any elements 
of off-campus study. As these students remained on their home campuses for 
the duration of their academic career, the categories of Experiencial Living 
with and within a Host Family Structure and foreign language were obviously 
omitted. , 

1. Major field, of study of participant. These categories proved to be 

signif Icvantly related to the major field of study of the student: 

Experiencial Living with a Room;nate 
Observation of Society Distinct from One*s Own 

Social Interaction with those of a Culture Distinct fx'o:n One's Ov'n 
Devolo'pnient of the 'Individual Person 

Fine artf> and liamaniV najors tehdei to have more positive scores on 
the oocial interaction/observing interaction type category. Students in 
t\\Q natural sciences tended to respond less po?>itively. The same pattern 
v;a.s located on t}ie Development of the Individual Person category and the 
Experiencial Living with ^ Roommate category. 

2. Extent of previous travel by participant . These categories were signi-. 

fif^antly correlated to the extent of previous travel the student hud 

experienced: 

Experiencial Living with a Roomate 
Development of the Individual Person 

Instructional Program Distinct from that Available at the Home Institution 
More travel seems to facilitate the development of a good relationship with a 
rocmate, of personnil growth, and of a positive opinion of the instructional 
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progrjun of the studen*^'s college or university. According to the tables, 
travel in foreign countries seemed most important in influencing such 
changes. 

3. Participatioa in off-campus study prograin . Comparing those students who 
had participated previously in an off-campus study program and those who had 
i\ever done so, significant differences on the following categories were 
located: 

Instructional Prograin Distinct from that Available at the Home Institution 
Observation of Society Distinct from One^s Own ' 
Feelings Directed toward the Home Institution 
Development of the Individual Person 

Unlike Fonns A and B, on which no significant differences appeared, Form C 

seems to indicnt.p that having participated in an off -campus study program 

may influence how the student who remains on his undergraduate campus for 

his undergraduate career perceives the home institution and its instructional 

program. Approximately one third of those students completing Form C reported 

a prior off -campus study experience. Persons with prior off -campus study 

scored more positively to the above experimental categories. 

Previous residence of participant . Only the attitude toward one's 
instructional program correlated significantly with residence of the student. 
Those students fran the suburbs tended to be most positive toward the 
instructional program of their home institution, urban students less so, and 
rural students least so. It seems that students from rural areas are least 
positive toward the instructional program of the hone institution of any 
student population. This is similar to the pattern found in both Forms A 
and 
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.. Present reading of local materials . Respondents who read more materials 
fnm nnil about the town or area surrounding the home campus responded more 
positively on the following experimental categories: 
Observation of Society Distinct from One ^ s Own 

Social Interaction with those of a Culture Distinct from One's Own 
DevelojHTient of the Individual Person 
Developing Tolerance . ' . 

\ Such findings may indicate that, for students who stay on their home 

campus, social interaction and observing of society relate most significantly 

to the reading of local material of these students. #Also, the general pattern 

of respoj>s^T-t;dicates a lack of interest or appreciation in a "foreign" 

culture . y 

p. General Conclusions and Implications 

^To thia point > a number of tentative conclusions from Form A may be 
statedv^^jM: would appear that. those individuals who were off-campus for the 
longest lengths of time> who were most involved in their program^ who had a 
strong commitment to a foreign language or who had traveled to the off-campus 
location previously saw themselves as developing the strongest in terms of 
tolerance, social interaction and appreciation of the foreign culture. 
Social interaction, appreciation of a foreign culture and the observing of 
society are most enhanced by the presence of a host family where this is 
possible. It would sfeem that participation over a longer period of time in 
the off-campus location, the use of a foreign language and the presence of 
' '^a host fajTiily, are most significant a actors as perceived by the student. 
The factors Especially relate to the student's continuing to read material 
about and from the off-campus location, and continued participation in 
correspondence with individuals from that location. 
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Kewer sys lematic differences were located for Fonns B and C. Extent 
of pi^eviuus travel by the participant, length of stay for Form B students, 
and participation in previous off -campus study programs were not associated 
with differences in. the experimental categories in the same manner as was 
found for Form A. Patterns similar to Form A results were located for persons 
of various majors and various previous residences, i.e. rural, urban, suburban. 
Precise differences between groups of students on A, B, and C are found in . 
the table^. of mean^^ within the appendix. Differences in patterns of responses 
by students on Forms A, B, and C may be as much a function of types of / 
students responding. as the types of programs in which they have participated, 
to this point.. Estimates of the magnitudes of effects on students from various 
prtgrams ai*e confounded by student self selection into programs. Longitudinal, 
prc-post- assessment will minimise this confounding. Such data will be avail- 
able at the completion of phase II. 

In conclusion, phase I of this project has generated instruments' that 
liave boefi capable of locating significances betv;e€in various groups of students 
v;lio participate in off -campus study programs. Appendix G shows the specific 
items from Form A, to be retained for phase II of the project. These are 
items that have shown high item to experimental category total correlations, 
i.e, they are measuring v;hatever trait is being measured by the category 
it.self. -Theje items also represent breadth, of content (content validity) 
in that they include the important aspects 6f the experiml^ntal category. 
For example, the five items for the Observation of Society Distinct from 
One^s Ov^'n category provide a broad perspective of tne topic, observing society, 
ratiier than one narrow focus of this area. Hence logical and empirical 

I 

validity were considered i.^olu^ errort to reduce the number of itemo required 
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on the instriuneat. The instriunents used to collect that data reported above 
appear as Appendix B. The current revision of the instruments to be 
Ui^od during phase II appear as Appendix I. ^ ' 

' ' V ■ ■ ■ ■ . / ^ • 

V. The Emerging Results^ Phase I ^^ 

In most research projects, the reader 'might rightly expect to find a 
section at this p.aint of the report giving the "conclusions" of the project. 
To do such in this project, however, would be misleading and Incomplete • 
The project, during phase I, has located various interrelating variables, 
but the experimental and the developing nature of the instrument throughout 
this first phase as well as the varying means by vhich different on-catilpus 
directors sampled their students, makes it impossible to go much beyond 
the mere listing of what could be called "emerging results;^' Cleai^ly the 
termination of 'phase, I does find certain results emerging, but the reader is 
cautioned to view these results as tentative at this point. 

All of this having been said, the following represent the most intriguing 
results of phase I: * 

First, the replies of students responding to the instrument were 
analyzed tc) asi^^r^^tin if background characteristics varied systematically with 
program <aitcomes. It was discovered that students of different academic 
majors .responded differently, with students in the hamanitiet; scoring category 
items significantly more favorably than students in the sciences. This 
pattern of differences of associations with a student's major field' of study 

rrimary rt-oponsibilily for this ction v;as assar.ed by Vi\ V'alter ii. 
Leinke, Jr., Associate Project Director. ^ 
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occurred more frequently on t"orm A. than on Forms B or C» This is in line 

.with what prior research would have hypothesized. > ' 

Second, associations of statistical significance were found between the 

thirteen experimental categories o^^ th:? instrument and (l) the student's 

present interest in the area of the off-campus study, (2) the student'* s 

"present amount of reading about that area, and (3) the student's present 

funount of correspondence with individuals living in the -off -campus ctudy 

i 

location. On Form A, those students who gave the most positiye responses 
(i.e., claimed the most positive outcomes from their study experience) also 
indicated a sustained interest and involvement in the location of the off- 
campus study. These patterns emerged less frequently on Forms B and C. 
Third, the length of stay at the off -campus location was cldsely 
^ associated with the outcomes as reported by the students on F^rm A, but not 
always in the came direction. For example, longer stays off-campus were 
related to higher scores in categories like "Comparing and Observing Societies 
Different from One's Own," but they were also related to lower scores in the 
category of ^^Developipg Tolerance.^' Longer stays were also associated with 
improved reported f6reign language fluency and the use of the foreign 
'language, as well as with a more positive image and a more positive evaluation 
of the instructional program at till off -campus study location. 

Fourth, statistically significant differences existed between category 
scores of students who studied in various Icch^ons throughout the world. 
In the five major geographical areas considered (Europe, Africa, Middle Kast, 
Central and South /vmerica, and the Far East) the general pattern of responses 
indicated that students in non-European locations responded more positively 
on the various experimental categories. " • 
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Fifth, the presence oC-a "host frlmily^' cr roommate resulted ia no 
systematic differences in the scores o'f the experimental categories on 
Form A. The same rebuli ocwrred on the rooa\mate category on Fornp B. 

In brief commentary on. those tentntive* findings , differences linked to 
the taudent's major field of^study are not surprising. One mi^^ht reasonably 
expect that tliose factors determining one ^ s major coiild also^be of irjfluenee 
in any changes which occurred in the student's perceived affective values. 
Similarly, those students reporting a high involvement with the area- of 
their off-caiBpus study, as. measured by their present reading and correspond- 
ence habits, could be expected to rate their off-cajnpua experiences quite 
positively. 

More unusual were results from the item concerning the length of stay 

at the- off-campus location. The most positive student reported outcomes 

■ / 
were from those who had studied off-campus from 27 to 52 weeks. Interest- 

inglyv the secOiVl most positive time duration was that of ten weeks or less. 

One might speculate that those students in the latter group were highly 

>^ motivated and stayed so little time that the expected period of disillusion- 

\ ment never could have occurred. These two results would indicate that 

prograias of one year's length and of 10 weeks or less (i.e., summer programs 

or one month interim programs) are presently the best opportunities for 

poj.;itive affective chang<^ By implication, those programs of' one quarter 

or-ono semester might be tuO short to permit an optimistic npswi.ig after a 

"down" period and too lonp; to sustain nn initial impetus of high pcrr.onal 

taotivation. As this proj^:^ct eventually plan.^i to continue mensu/oment after 

a two year and a four year interval f(>llowiri{5 the ;:.ri:uient's return from 

off-cairipus study, it will be extremely helpful to see if both time duration 
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groups romaia cugnif icaivt or if thu ''10 weeks or less'' group proves to be 
of irmiediate impact oaly. * 

Coticerning the tentative results apropos of the geographical location 
of the off- campus experience, one would hypothesize that such findings would 
likely enierge. Logically, experience in a culture quite similar to the 
student's own would probably affect less change than experience in a culture 
radically different. Thus, students studying in Europe indicated fewer 
favorable responses than those staying in Central and South America, the 
Middle East, and Africa, These findings surely do not, at this point, imply 
the, abolition 6f study prograjiis in Europe. Rather, these results indicate 
what kind of outcomes may be expected in students choosing various geograph- 
ical areas. Further, desired affective changes cannot be divorced from 

desired academic opportunities.- Obviously > the total impact of a program 

j 

in Africa should differ from that of a program in Western Europe or New York 
City/' Program directors and those administrators ftiaking -policy decisions 

v;ould \sureiy profit in knov/ing the direction and intensity of affective ^ 

I 

changes which are likely to occur in specific programs. 

FitYLlly, the lack of systematic differences^ to this point, based on 
the pres^rice or -absence of a host family or roommate is really not astounding 

after some consideration. Rather than the presence or abocnce^of the two 

\ ' 

factors, t^ie quality of the relationship between the American student and 
the host f^imily or the rooirirriate appears significant. In the latter instance, 
there is a correlation between the quality of the relationship between the '\ 
roorrinr-ites and the major field of study' of the individuals. Data will be 

clearer en the quality of th^/'C relat-lcnship:-: ia phase 11. 

/ 

i 
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Again, one must caution that these initial findings are tentative. 
The ioi as a measuring instrument is still in experimental development, 
Cotivdrsely, these early results are certainly interesting and, on occasion, 
arresting and provocative. 

If the TGI proves successful at the end of phase II, the advantages 
of its availability would be numerous. Practically, an assessment instrument 
cf off- campus study prcgrairiS would prob'^bly be welcomed by those presently 
involved in the organization and direction of such programs. While control 
of selection criteria is explicitly not one of the goals of the lOI, predic- 
tions of student outcomes would prove immeasurably valuable. High school 
counsellors, undergraduate advisors and all foreign language people co\U.d 
begin to plan and to advise according to reliable information rather than 
according, to guesses. Students could also know within cc'rtain limits what 
to expect of an off-campus program. 

Second, those responsible for implementing off-campus study prograias 
of specific natures would have an instrument capable of providing crucial 

infoi^mation on which consequential decisions could be based. As an illustra- 

'\ 

tion, program administrators stressing fluV(icy in a foreign language would 

know that the most beneficial results might b^^expected from a constellation 

'''^\ ■ 

of specific factors. Another program directed by' a religiously oriented 
institution might want to devise a way to stress the deyelopment of tolerance 
and the development of the value syste:a of the individual." -!^ both cases, 
thoi'o specific values described as objectives might be more effectively 
measured with the use of the TOI . The process of implementing goals would 
be indicated by the compariGon of the predictive scores on the measuring 
instruTicnt before the student '-s departure and the ultimate scores upon return. 
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Third, the lOT would inako a sortie into the domain of educational 
accountability. Federal aad state feovernraetits , for example, have grown 
increasingly cu^^ious and aggressive in their demands for financial accounting 
and responsibility. This trend will not be reversed in the future, as higher 
education. becomes more expensive, tax dollars rarer, and private contributions 
more selective. The golden age of higher education, symbolized by the formerly 
glib professorial attitude toward grants, is now a legend. From legislators 
c(mnting Lax dollars to parents footing the bills to students stepping into 
charter flights, the range of accountability is wide and its nature deijjanding. 

As the Carnegie Commission has so convincingly dcMonstrated in many of 
its publications, assessment and accountability, now crucial concepts in 
education, will surely enter the permanent, professional lexicon. Thus the 
Individual Opinion Inventory is designed for those involved and concerned 
with off-r-snnus education. If traditional natural boimdaries dissolve and 
suoranational or regional attitudes present new perspectives, the comprehension 
of the mechanisms of attitudinal change in students will become more and more 
significant. As the concept of a world view gains ascendancy, educators must 
afford students those experiences deemed most likely, to be beneficial. 
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